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ABSTRACT 

This paper briefly addresses critical issues in 
documenting studies of the effectiveness of inclusive education for 
students with disabilities and includes a summary table of the 
existing literature and guidelines for problem solving about 
inclusion. The importance of sound methodology in documenting effects 
of inclusion and the dangers of value judgments regarding placements 
are stressed. Ten parameters that investigations of inclusion should 
cover are outlined, including achievement gains, social skill growth, 
opportunities for social integration, attendance, time on task, 
extent to which practices are embedded in routines, fidelity of 
practices, quality of Individualized Education Programs, longitudinal 
focus, and extent of parent participation. Attached are: a matrix 
susimarizing results of 12 inclusion effectiveness studies; an outline 
of principles of brainstorming; a summary of steps involved in using 
creative problem solving to define and measure inclusion; and a 
listing of ideas concerning measurement of inclusion efforts, 
generated at two brainstorming sessions. (Contains 9 references.) 
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Defining and Measuring Inclusion 

For many pracdtionets, inclusion is a term that is largdy defined by placement in the 
general education classroom (Andeiegg & Yergason, 1990). Noitetheless, numerous other 
sources specify the nature of the processes and outcomes that can be achieved through placement in 
the general education classroom (Rogers, 11)93, Sailor, 1991). Unfortunately, lack of consistent 
definitions and descriptions of pre- and post-inclusion measures as well as a lack of pte- and post- 
measures of achievement, social drill growth, and attitude changes complicate the picture ev^ 
further. Although many advocates describe inclusion as a process (Stainback & Stainback, 1990), 
the field of spedal education has expenenced tremendous difficulty in measuring the effectiveness 
of a moving target Consequently, a few researchers (Zigmond, Jenkins, Fuchs, Deno, Fuchs, 
Baker, Jenkins, & Coutbino, 1995) have established their own criteria for the success of stud^ts 
in inclusive (or mainstreamed) classrooms. Many professionals are left to decide (m their own 
whether measures that show **as good as” growth in the special class are to be pursued or rejected. 
Just how much better or how much growth needs to occur before we can agree tiiat success in the 
general education classroom has occurred? 

The field has learned from the methoddogical errors the d'ficacy studies (Goldstem, 
Moss, & Jordan, 1965) that single measures of “success” produce questionable validity. There is 
a need to delineate the success measures for research purposes but most certainfy for practitioners. 
Achievement (mean achiev^ent gtuns, months of achievement gain, comparisons of achievement 
gains) is one measure. Although one critically important measure, tiiese data are not routinely 
reported in publications. Satis£v:tion or perception (student satisfaction, teacher satisfaction, 
parent satisfaction) is also one measure. Satisfaction is not considered to be as robust a measure 
as achievement; but it is an important measure. Attendance, social growth, costs, numbers and 
types of pull-out programs, numbers and fypes of modifications, happiness, and qualify of lEPs 
have all been researched to demonstrate the effectiveness of inclusive practices. Although positive 
increases or gains in these areas tell us a great deal about a program's overall effectiveness, 
interpreting the increases is amore difficult ta^ 
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Value judgements regarding placements should he viewed with caution. For example, 
evidence does suggest diat pull-out programs lack both efficiency and efficacy (Gaitner & Lipst^, 
1987; Will, 1986). However, comparing a poor pull-out program with an dually poor inclu^ve 
setting does litde to further the knowledge base. It is also becoming increasingly clear that value 
jadgements about inclusive placements must also be viewed with caution. Althou^ inclusion has 
been accepted by a value by many advocates, Mercer (1994) reminds us that inclusion must be 
conducted respon^bly. By accepting one value (Le., placement in the general education 
classroom), we do not, by de facto, relinquish all others such as time on task, teacher problem 
solving, collaboration, and other best practices. Researchers must responsibly describe classroom 
environments and educadmial practices to fadlitate understanding and replication by the reader. In 
as much as inclusion must be carried out responsibly, so too should the research and the repotting 
of the results of inclusive practices be reported responsibly. 

WhatWe.£x pect InvestigatioiM} of Inclusion to Tell Us: 

1. Achievement gains; 

2. Social skill growth; 

3. Opportunities for social interaction; 

4. Attendance; 

5. Time on Task; 

6. Extent to which practices are embedded in routines (co-teaching, collaboration, cooperative 
learning); 

7. Hdelity of practices (extent to whidi i^actices confonn to guidelines); 

8. Quality of lEPs (active vs. passive focus, measurability, generalization, mastery, focus on 
priorities reflected in 'TYesent Levels,” goals/objectives achieved, appropriateness of content); 

9. Loiigitudinal focus or potential impact on Itmger term outcomes such as social networks or 
contributing citizens; 

10. Extent of patent participation in planning, activities, routines. 
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Typical Peers (TP) 



T35 

LD 

TP-LD 



TP-LD 



Documenting Your Inclusion Efforts 

better than (+), equal to (=), or worse than (-) the non-inclpsive setting. 
I Measute/Residts* Reference 



Individual AchievemantTests 

(+) 

Group Achievement Tests (=) 



Affleck, Madge. Adams, & 
Lowenbraun (1988). Integrated 
classroom versus resooice model: 
Academic viabili^ and 
effectiveness. Exceptional 
Children, 54, 339-348. 



CBA, leading (+) 

CBA, writing (=) 

Overall attitude toward school, 
motivation, self-concept (=) 



Banegi & Dailey (1995).A study 
of the effects of an inclusion model 
on students with specific learning 
disabilities. Jourrud of Learning 



DisabiKties, 28, S11-S22. 



Intent rating of child’s: sense 
of belonging, int^actions witii 
others, confidence, pride in 
work (=) 



TP-LD 

'H^andKiild 

Disabilities 



nr" 

E®D 

om 



Teacher rating of child’s: same 
as above (=) (TP higher on all 

tottiit^s^ _____ 

Group Achievement 'tests (=) 
(TP higher in math) 



lEP Goal compl^on (+/=) 
Grades (•(■) 

Absentee ^tes(-) 

Disciplinary Reports (-) 

Drop Out Rates (-) 

Populari^ (-) 

Seff-Esteem (+) 

Satisfaction of parents, teachers 

(+) 

Achievement increase (■«-) 



Bear & Proctor (1990). impact of 
a full-time integrated program on 
the achievement of 
nonhandicapped and mildly 
handicai^)ed childtmi. 

gcceprio^Iity, ij 227-23B. 

Delv^ Kozot, Merchant, h 
Moms (1994). Perspectives and 
outcome data for teaming disabled 
students in the cooperative 
Caching model. I^per presented 
at the Learning Disabili^ 
Association Conference, 
Washington, D.C. 



"BP 



Individual Achieveaient Tests 

(+) 

GJP.A. (+) 

Absentee Rate ( ) 

Teacher ratings: attend^ 
working bmd. adjustment (-<-) 



Meadows, Neel, Scott, & Parker 
(1994).Academic performance, 
social cmnpetence, and mainstream 
accommodations: A look at 
mainstreamed and 
nonmainstieamed students with 
serious tehavioral disorders. 
Behavioral Disorders, 19, 170- 



180. 
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Modi^lyMR 


Adaptive Behavior (=) 

Math Achievement Tests (=) 
Report Cards (=) 


Saint-Laur^t, & Lessaid (iwi). 
Comparison of three educational 
programs for students with 
mo^rate mental retardation 
integrated in regular schools: 
Preliminary results. Education and 
Traitmg in MenUd Retardation, 

26. 37(>380. 


LD 


CBA reading (=) 
‘nmeonTask(+) 


IQgmond & isaker(i990). 
Mainstream eiqtoiences for 
learning disabled students (Project 
MELD): Frdiminaty repotl 
Exceptional chitdren, 57, 176-185. 


LD (case study) 


Engaged tiine in reading (+) 
CBA reading (+) 


2Sgmond & Baker (1994). Is the 
mainstream a more tqipropiiate 
educational setting for Randy? A 
case study of one stud^t with 
learning disabilities. Learning 
IXstdjtiities Research A Practice, 
9, 108-117. 


Severe Disabilities 


IEPQuaUty(+) 

Appropriate Curricular Content 

Engaged Hme (on ta^) (+) 
Integrated Activities (+) 
Affective Demeanor (») 

Sodal interactions (+) 


Hunt, Farron-Dam Beckstead, 
Curtis, & Goetz (lSb4). 
Evaluating the effects of placement 
of students with severe disabilities 
in general education versus ^lecial 
classes. MSH, 19(3), 200-214. 


Severe Disabilities 


In-school Contacts (+) 
Out-of-school contacts (+) 


Kennedy & Itkonen (1994). Some 
effect of regular class participation 
on die social contacts and social 
networks of high school students 
with severe disabilities. JASH. 

mi), I-IO. 


Severe bisabilities 
TP 


Motor Skill Acquisititm (+) 
Communication Skill 
Acquisition (+) 

Madi skills (=) 


Hunt, Staub, AlweU,^ Goetz 
(1994). Achievement by all 
students within the context of 
cooperative learning groups. 
JASH, 19(4), 290-301. 


TP 

SpEd (all) 


Awar^ess of excq>tiQnaUties 
(+) 

Kind, suiqiortive, protective (+) 
More “humanuecf’ (+) 

Lack of achievement drop 

Known as individuals 
Independence (+) 

Self-esteem (4-) 
lEP objectives met 


National Cmter on^ucational 
Restructuring and Liclusion. 
(1995, Fall). NCERJ Bulletin. 
2(2). The City University of New 
Yoric: Author. 
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Rationale: 



Brainstorming 




Brainstorming, with its use of drferred Judgement , implicitly creates a receptive, creative 
atmosphere and teaches good creative attitudes; receptiveness to and appreciation for novel- 
ideas. Biainatotming is an efTective procedure that may be used in the cla^room for 0) teaching 
brainstonning as an effective creative thinking technique, (2) practicing creative thinking (thus 
strengthening attitudes and abilities), and/or (3) saving some pressing school problems. 

(Davis, G.A., & Rimm, S.B. (1989). Education of the gifted and talented (2nd Ed). 

Englewood Cliffs, NJ; Rentioe Hall) (p. 233) 



Encourages: 

^Action orientation 
A Divergence-Open atmosphere 

^Equity of participation (no “gender/backgroimd” restrictions) 
A Fluency of ideas 
A Group effort 

ANo self-censoring; thus no self-limiting 
^Openness to experiences 
^Productivity 
i&Self esteem 



Teachers who use increase in: 

^Empathy 

©-Being open to students 

©Listening intently to student responses and idea 
©Reinforcing students 
©Allowing students to experiment 

(Piiito, J. (1994). Talented children and adults. New York: Meirill/Macmillan) (p. 165) 
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Using Creative Problem Solving to Define and Measure Inclusion 




Piupose: To demonstrate the use of sevaal ctmvergiag and diverging tools designed to actively 
involve participants. 

Rationale: Cieative Ftoblem Solving can be used to develop a list of dependent variables that will 
infcmn us of die progress of our efforts in establishing inclusive practices. 

Overview: This approach is ustful when trying to generate ideas and involve the interested parties. 
It works best when4 to 8 people participate in a group. Larger groups can form two or more 
^ultaneous groups. This particular approach is easily modified and does not focus on 
fundamental change, but rather improvements. 

Procedure: 

8itep 1: Develop a problem statement for discussion. 

Description: Oftentimes through discussirni and probing teachers, parents and administraiois are 
able to identify topics or processes they want to clarify or investigate. 

Bcample : How can a school team know whmi tiiey are making progress with students, teachers, 
or families when th^ have moved to an inclusive educational model? 

Today’s Ta.sk .Statement: Imagine, if you can, that you are in the planning or implementation 
phases for inclusion. You want to know if this is a good thing for students-those with disabilities 
and tiiose without You have bean) concerns voiced by teachers and par^ts and you want to be 
dow that things are going weU. In ^ort, you want some proof 11 

St^ 2: Backgrcund-Spend a few moments and record the events that have ensued thus far in 
your school’s efforts toward inclusion. Who was involved? What was done or not done? How 
was planiung accomplished Of at all)? What outride assistance was sought or available? Which 
students and which teachers were targeted? What new terms were invented to describe what was 
happening? How woe decisions made? Take notes on these issues and review them with others. 
Idea Phrase: We see ourselves developing tiie criteria by which we vriil measure our progress 
toward inclusion. We want to know it ail~the good, the bad and the uglyl 
Desired Outcome: To decide what information we can collect to inform our efforts. 

St^ 3: Brainstorming-Each participant witii a stake in the outcome should have an opportunity 
for input during the Brainstorming phase. Each participant is provided with post-it notes and a 
pen. The phrase “In what ways might we noeasure our efforts toward tnclurionT* is placed on a 
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large poster sheet Participants are leqiKsted both to write (in legible form) their ideas and to say 
their ideas aloud as they hand them to the facilitator. 

Guidelines; 

-Defer judgement on any and gll ideas. 

•Strive for a large quantity of ideas (think of as many as you can). 

•Connect ideas to create new Ideas (build on another’s idea). 

•Be outrageous-^anything goes during brainstorming. 

•Keep the pace snappy. 

If ideas run dry loo quickly or lack pizazz, the facilitator can use an idea checklist or provide a 
visual prompt that stimulates a forcing of connections between the prompt and the problem 
statement (e.g., How is measuring inclusion like driving on die interstate highway?) 

Step 4: Sorting ideas-The objective is to sort, screen, combine and select the most promising 
ideas. Participants are asked to identify ideas for further wodc or identify ideas that are intrigumg 
or promising. Each participant is given 1-2 sticky dots with which to make a selection of 1-2 
ideas. Each participant places their dots on the post-it with the idea of dieir choice. 

Guidelines: 

-Use positive judgement in selecting ideas. 

-Consider tiie plan. 

-Consider novelfy. 

•Keep the problem firmly in mind. 

Step 5: Closute-The facilitator moves the dotted (sdected) ideas to a separate chart and reviews 
the ideas with the participants. From this point several fypes of outcomes may be approiniate. A 
plan for what will be done by whom by what date can be developed; a recording of the hot ideas 
can be developed; the ideas can be ranked, inioritized, compared, categorized or evaluated. 

The Problem Solving Process can (and should) be fiin! It helps get new ideas out for discussion 
and helps all die participants engage in an organized approach. It does not solve all problems but it 
can be a very useful approach. 



10 



Ideas generated at the April 4, 1996, piesentaticm in Orlando, FL. 

In what ways might we measure our efforts toward inclusion? 



SELECTED BY THE GROUP 

•extent to which stodoits’ objectives on lEPs 

ate being met (11) 

-self-concept scales (11) 
measure objective success (6^ 

-increase of teacher use (tf strategies for aU 
s^dents, eg., co-op teaching, hands on (6) 
-improvement in academic sWlk (S) 

•check to see if the UtE on the lEPs show 
le^er restriction over time (4) 

-informal portfolio assessments (4) 

•change in teaching strategies of co-teachers (4) 
-increase in collaboration efforts between 
general and special educators, measure time 
spent (3) 

-acceptance by dassmates (2) 

-self-esteem (2) 

-pre- & post-tests on self-estem for all kids 
-teacher satisfaction/teacher s«ise of 
competency stirv^ 0^) 

-vidmtape indusive classrooms several times 
throughout scbocd year, focus on soda! 
interactions (1) 

-survey staff, students, parents (1) 

-levd of awareness (of inclusion) of school 
employees, school board memb^ (1) 
-collaboration efforts of general qiecid 
editeators increased over tinte (3) 

•exit ffom special education (1) 

-post-high ^ool or exit studi» of independent 
hving(vocational ridlls(l) 

-teacher attitude survey (1) 

-general education studmt achievement scores 

( 1 ) 

-increase in cross-curricular involvement in 
plaiming^projects (1) 

-homeworic completion (1) 

-times that nondisabled student spend with 
disabled students outside of school, ie., going 
to mdl, modes, playing at ffimids* homes (1) 

CQMPLEIEUST 

Students-Social 

•sociograms 

-sodograi^ to determine social interactions 
-increase in firiendships 
-friendship development 
-fiiendships 

•re^nses in student journal-student journal 
entries 



-observation/survey by teacher 
-self-esteem 

-increase in positive interposonal relationships 

-body language 

-student interviews 

-student questionnaires 

-student attitude survey 

Teachecjelated 

-staff happiness 

-staff discussion 

•teacher communication 

-teachei/studmit lapprut 

-attendance at staff development for inclusive 

programs 

-comparison data on burnout rate of special ed 
teachers 

-staff turn-over, burnout 

-monitor amount time general ed teachers spend 

in accommodation of students 

-measure number of hours in 

planningAteliaboration 

-coUaboiaiion betwemi classroom teacher & 

^tedaled teacher 

-increase in collaboration among 

teacher^amotm students, survey 

-recognition or special ed teach^ by student 

body 

-positive vs. negative: teacher infonnal 
discussions Gounge, etc.) 

Parent-relai^ 

-acceptance by parents, public 

•increase in positive interactions witii parents 

-awareness and acceptance of disabilities by 

classmates increased, survey 

-student, teacher, parent surveys 

-questionnaires st^, parents, students 

-at parent conference nme teachers interview 

parents re sati^action 

-survey parents of nondisabled peers 

-parent surveys 

Cnmmunitv-telated 

-survey agtmcies, advocacy groiqis, 

communi^ groups 

-comparison of local media reports from pie- 
and post-indusion years 
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Propam-ielated 

-disaplines lefeirals 

-behavior problms 

-fewer Spra lefenrals 

-nature df special ed referral reasons 

-rdfeirals to special ed, guidance, discipline 

-behavior management plans-inctease in 

appropriate behaviors 

-monitor number of referrals to spedal ed 

-demographic information comparison (number 

of Idds in self-contained in *93 vs. *96) 

-track mnnbmr of interventions, number of 
successes 

-reduction in costs through maTomizing use of 
resources 

•continued funding levds for support smvices 
-reduction in doe process proce»lmgs 
-reduction in parent complaints 
-reduction in panmt complaints 
-reduction in somatic cmnplaints 

•continuum of services 

-environmental survey (llES II) 
-eco-biotegical observations 

-language acquisition 

-by percentage of lEP goaisfebjectives attained- 
rate lEP goals/obiectives attained 
-monitor progress of lEP goals, acatfemic and 
social 

-IBP data sheet: docummrts when goal is 
worked on 
-test scores 

-Honor Roll-times special education studetus 
make honor roll 

-number of **normal” Idds on honor toll 
-grades 

-completion of asagnments 
-homework, classwotk completion 
-achievement 

-increase in student classroom work 
-task completion 

-risk taking by qsecin^ ed students in course 
sdectioDs fer the oe.^<. year 

Attendance 
-attendance increased 
-attendance 
-attendance 
-attendance 

-attendance improvement or deaeasc 
-drop out rate 
-drop rates 

-decrease in drop outs 



-studait crime statistics 
-decrease in lEP hours 

Level of Participation 
-amount of participation 
-coq;>erative learning (observation between 
students, interactions) 

-studmit motivation in classes 
-increase/deciease in class participation 
-involvement in cultural arts events 
-observe class interaction 
-wilUngne^ to ask questions in tire group 
■extia*cunicalar involvement 
-monitor service delivoy patterns of students 
-change in administrators’ attitudes 
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Ideas generated at the March 8. 1996, presentation in Indian^Mlis. IN. 

In what ways might we measure our efforts toward inclusion? 






student success in general ed class (9) 
decrease in lefenals as general teachers learn 
firom q)ec Ed teacher how to modify (4) 
general ed teachers making modifications on 
their own (4) 

collaboration betweea special ed and general ed 
staff (3) 

comfort let^ of the teachers (3) 
students' self-esteem (3) 
entire school is participating in inclusion (2) 
types of lEP goals/objectives (1) 
how studmits feel or what they express about 
their experiences (1) 

number of trips to the {uincipal's office (1) 

COMPLETE LIST 
administrator’s oj^on 
0 ^ communication 
fiiendship made 
community involvement 
questions asked 
how they dress 

observations of relationships of special ed and 
gen ed students 
student attitude changes 
communication increases 
number of modifications being done to the gen 
ed curriculum 

inteiest/questions from peers in education 

“test iBsults”-the numbers 

use a combination of the following: 

-number of students in gen ed; 

-reaction of students, parents, staff to the 



of presence (Complaints from parents 
student’s success 

the student is able to mention that there are 
parts of tile school day the be/she tikes 
nurse referrals 

‘tol^ons” between students (fights, 
arguments, etc.) 
learning from our mistakes 
number of conflicts involving special needs 
studmits 

students in ^ ed and gen ed sitting together at 
lunch 

number of t^s to the bathroom 
curriculum match or mismatch between spec ed 
and gened 

number of teacha* referrals 
number of journal artides about inclusion in 
teachers’ lounge 

how many wrong turns, accidents, traffic jams, 
pile-ups, fati^ties, 

amount oi communication between teachers 



program 

•successes of students 
special ed teacher attrition rates 
number of smiles 
friendships developed 
parenttfamily response to inclusion 
social interaction (between spec ed and reg ed) 
peer tutoring 

number of fSP conferences 

general education teacher questionnaires 

ability of students to perform “functional life 

skills’’ 



curriculum mastery 
number of teacher complaints 
name-calliitg (esp. reg ed dissii^ ^ ed) 
number of students who are includ^ in fien ed 
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